Goto

Collaborating Authors

 federated machine


Unlearning during Learning: An Efficient Federated Machine Unlearning Method

arXiv.org Artificial Intelligence

In recent years, Federated Learning (FL) has garnered significant attention as a distributed machine learning paradigm. To facilitate the implementation of the right to be forgotten, the concept of federated machine unlearning (FMU) has also emerged. However, current FMU approaches often involve additional time-consuming steps and may not offer comprehensive unlearning capabilities, which renders them less practical in real FL scenarios. In this paper, we introduce FedAU, an innovative and efficient FMU framework aimed at overcoming these limitations. Specifically, FedAU incorporates a lightweight auxiliary unlearning module into the learning process and employs a straightforward linear operation to facilitate unlearning. This approach eliminates the requirement for extra time-consuming steps, rendering it well-suited for FL. Furthermore, FedAU exhibits remarkable versatility. It not only enables multiple clients to carry out unlearning tasks concurrently but also supports unlearning at various levels of granularity, including individual data samples, specific classes, and even at the client level. We conducted extensive experiments on MNIST, CIFAR10, and CIFAR100 datasets to evaluate the performance of FedAU. The results demonstrate that FedAU effectively achieves the desired unlearning effect while maintaining model accuracy.


Decision Models for Selecting Federated Learning Architecture Patterns

arXiv.org Artificial Intelligence

Federated machine learning is growing fast in academia and industries as a solution to solve data hungriness and privacy issues in machine learning. Being a widely distributed system, federated machine learning requires various system design thinking. To better design a federated machine learning system, researchers have introduced multiple patterns and tactics that cover various system design aspects. However, the multitude of patterns leaves the designers confused about when and which pattern to adopt. In this paper, we present a set of decision models for the selection of patterns for federated machine learning architecture design based on a systematic literature review on federated machine learning, to assist designers and architects who have limited knowledge of federated machine learning. Each decision model maps functional and non-functional requirements of federated machine learning systems to a set of patterns. We also clarify the drawbacks of the patterns. We evaluated the decision models by mapping the decision patterns to concrete federated machine learning architectures by big tech firms to assess the models' correctness and usefulness. The evaluation results indicate that the proposed decision models are able to bring structure to the federated machine learning architecture design process and help explicitly articulate the design rationale.


Prospects of federated machine learning in fluid dynamics

arXiv.org Artificial Intelligence

Physics-based models have been mainstream in fluid dynamics for developing predictive models. In recent years, machine learning has offered a renaissance to the fluid community due to the rapid developments in data science, processing units, neural network based technologies, and sensor adaptations. So far in many applications in fluid dynamics, machine learning approaches have been mostly focused on a standard process that requires centralizing the training data on a designated machine or in a data center. In this letter, we present a federated machine learning approach that enables localized clients to collaboratively learn an aggregated and shared predictive model while keeping all the training data on each edge device. We demonstrate the feasibility and prospects of such decentralized learning approach with an effort to forge a deep learning surrogate model for reconstructing spatiotemporal fields. Our results indicate that federated machine learning might be a viable tool for designing highly accurate predictive decentralized digital twins relevant to fluid dynamics.


Decentralized digital twins of complex dynamical systems

arXiv.org Artificial Intelligence

In this paper, we introduce a decentralized digital twin (DDT) framework for dynamical systems and discuss the prospects of the DDT modeling paradigm in computational science and engineering applications. The DDT approach is built on a federated learning concept, a branch of machine learning that encourages knowledge sharing without sharing the actual data. This approach enables clients to collaboratively learn an aggregated model while keeping all the training data on each client. We demonstrate the feasibility of the DDT framework with various dynamical systems, which are often considered prototypes for modeling complex transport phenomena in spatiotemporally extended systems. Our results indicate that federated machine learning might be a key enabler for designing highly accurate decentralized digital twins in complex nonlinear spatiotemporal systems.


Federated Machine Learning for Intelligent IoT via Reconfigurable Intelligent Surface

arXiv.org Artificial Intelligence

Intelligent Internet-of-Things (IoT) will be transformative with the advancement of artificial intelligence and high-dimensional data analysis, shifting from "connected things" to "connected intelligence". This shall unleash the full potential of intelligent IoT in a plethora of exciting applications, such as self-driving cars, unmanned aerial vehicles, healthcare, robotics, and supply chain finance. These applications drive the need of developing revolutionary computation, communication and artificial intelligence technologies that can make low-latency decisions with massive real-time data. To this end, federated machine learning, as a disruptive technology, is emerged to distill intelligence from the data at network edge, while guaranteeing device privacy and data security. However, the limited communication bandwidth is a key bottleneck of model aggregation for federated machine learning over radio channels. In this article, we shall develop an over-the-air computation based communication-efficient federated machine learning framework for intelligent IoT networks via exploiting the waveform superposition property of a multi-access channel. Reconfigurable intelligent surface is further leveraged to reduce the model aggregation error via enhancing the signal strength by reconfiguring the wireless propagation environments.


Federated machine learning is coming – here's the questions we should be asking

#artificialintelligence

Wouldn't it be better if we could run the data analysis and machine learning right on the devices where that data is generated, and still be able to …


6 trends that will drive AI deployments in 2019

#artificialintelligence

Artificial intelligence is poised to break out of the hype cycle and become an important element in strategic business planning. A lot has been written about AI over the last year, but much of what has been offered for public consumption has been superficial and, in some cases, misleading. AI is neither a simple panacea poised to solve all our business problems, nor is it a looming evil ready to usher in a dystopian future. It is a powerful tool that can aid decision making in a fast-moving, digital business climate--and there's ample evidence that it's already happening. As machine learning practitioners who have spent the better part of their careers involved with AI and machine learning, here is a look into the future of AI.


FEDERATED MACHINE LEARNING – Towards Data Science

#artificialintelligence

This article is about Federated Machine Learning, one of the latest and most celebrated approaches being explored in the world of machine learning, which focuses on utilizing the power of distributed systems to train and enhance machine learning models. With advent of IOT and increase in the usage of smartphones number of endpoints having data has increased exponentially. However, the traditional approaches of machine learning are not equipped to deal with such vastly distributed data and train models on it. The traditional machine learning approach consists of a central server to store data and train models. There are two ways then to use such trained models.


Android Gboard smartens up with federated machine learning

#artificialintelligence

Google has begun using a machine learning approach to learn from user interactions with mobile devices. Currently under testing in the Gboard on Android keyboard, Federated Learning lets smartphones collaboratively pick up a shared prediction model while keeping training data on the device. This way, the need to do machine learning is decoupled from the need to store the data in the cloud. Federated Learning provides for smarter models, less power consumption, lower latency, and ensured privacy, Google research scientists said. The model on the phone can help power experiences personalized by how users interact with the device.